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© Feature-region extraction method and feature-region extraction circuit 

® onInL P T 6nt j!] V r ti0n iS lntended to exactly extract a feature-region along its contour line without 
erroneously extracting any moving object other than the feature-region. An extraction signal from a 
?n^™^?.i m !t P< f2 n eXt y, actjn ? circult < 1 > is sent to a small region eliminating circuit whereby 
° n *°" S T" reg, ° n iS deteCted and *™natad as an erroneously extracted noisj 

dkSnltot *>™f reQ, ° n e, ^ ,na ^9 «»»(2) compares a small region with four detection patterns 
dSS? - fwfndnf n?{ e9 T ^f^ 3 " the f ? ature fac *-^°n rf no match is found and causes a cente 
drcuit ff> sent o . rir° ^ a f ^! ca ' of * ero - An output of the small region eliminating 

S c^linif J! f , b 3nk fi, ^ ng C,rCU,t (3) which °«np«s its input with four detection patterns 
d.scrirnmates it as a face-region if a match is found and makes a central pixel of a window of 13 13 

^^l^l^^nP 19 above ' mentioned taction method can reliablyT^act features of 
the face-region and is free from the erroneous extraction of any moving object other than the face. 
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BACKGROUND OF THE INVENTION 

The present invention relates to a feature-region 
extraction method and a feature-region extraction cir- 
cuit and, more particularly, to a feature-region extrac- 
tion method and a feature-region extraction circuit 
which are capable of extracting a feature-region of an 
image for processing the image according to its fea- 
ture at a pre-processing portion of an image coding 
device and which are intended to be used, for exam- 
ple, in video telephone systems, video conference 
systems and so on. 

At a motion picture coding and transmitting de- 
vice for a video telephone, since any transmission line 
has a limited capacity to transmit a number of bits at 
a time, it cannot allocate enough bits to an image in- 
formation. Accordingly, a decoded image may have 
an impaired picture quality with a mosquito-like dis- 
tortion, a block distortion and the like. On the other 
hand, most of the images to be transmitted include an 
important portion and less important portions. On the 
basis of this fact, a method is proposed that reduces 
the subjective deterioration of an image quality by 
keeping the important portion free from the ill effects 
of deterioration. 

For example, at the systems such as video tele- 
phone system, the image of face region is so impor- 
tant that their systems has been studied in extracting 
the face region, preferentially allocating the amount of 
information transmitted and making the image quality 
of the face region better, aiming at improvement of the 
subjective image quality. 

The prior art that is concerned with the present in- 
vention is disclosed in the publication "Color motion 
picture coding device featured by preferentially proc- 
essing a face image" (Hideyuki Ueno, Image Informa- 
tion vol. 24, March 1992, pp. 29-35). The face-region 
extraction method of the prior art described in the 
publication will be explained as follows. 

The prior art first determines the difference be- 
tween two neighboring frames of the motion picture 
inputted to get the interframe differential image and 
then divides the interframe differential image into 
rectangular regions. In the respective rectangular re- 
gions, the method makes a histogram representing 
the number of pixels, in which the interframe differ- 
ence signal is larger than a certain threshold, on an 
H-axis. The method scans the histogram from the left 
and the right comparing its values with a certain 
threshold "th w to detect the left and right ends of the 
moving region. 

The image screen is scanned from the upper left 
end until a first moving region is found. This moving 
region has a coordinate on a V-axis, which represents 
a position at the top of one's head. The image screen 
is then scanned from the left and the right by a certain 
range of lower image to determine the left and right 
ends of the moving region. And then, the outermost 



positions of the moving region on the H-axis repre- 
sent the coordinates of the left and right ends of the 
face. The face length is determined by multiplying the 
face width by a predetermined coefficient "a". The pri- 
5 or art considers the thus determined image region as 
a face-region. 

As mentioned above, the conventional feature- 
region extracting method estimates a face-region 
from an interframe difference signal representing the 
10 amount of motion. Consequently, if the image in- 
cludes any other moving object than the face-region, 
the prior art method may erroneously take the object 
as a face part. Furthermore, the method can roughly 
extract a face-region only in the form of a rectangle, 
15 which contour may be emphasized when the regions 
other than the face are adaptively processed with a 
low-pass filter. This may impair the subjective image 
quality. 

20 SUMMARY OF THE INVENTION 

It is an object of the present invention to provide 
a feature-region extraction method and the feature- 
region extraction circuit, which can extract a feature- 
25 region exactly along its contour without erroneously 
extracting any other moving object than the feature 
one, thereby allowing adaptive processing of portions 
other than the feature-region without impairing the 
image quality and can extract a face-region from col- 
30 or difference component regardless of the movement 
and location of a person or a number of persons, im- 
proving the subjective image quality. 

It is another object of the present invention to pro- 
vide a feature-region extraction method whereby a 
35 small color difference region including a feature color 
difference component of a feature-region is located 
within a color difference coordinate system defined 
by two axes representing two respective color differ- 
ence signals and an image region, which has a color 
40 difference component in the small color difference re- 
gion mentioned above, is extracted as a feature-re- 
gion; the small color difference region can take any 
desired form thereby eliminating the possibility of er- 
roneously extracting any moving object other than the 
45 feature-region; the feature-region can be exactly ex- 
tracted along its contour line to make the image more 
natural and to have a subjectively improved quality 
and, therefore, can withstand adaptive processing of 
other regions with a low-pass filter and, furthermore, 
so only color difference signals are applied for feature- 
region extraction to prevent erroneous extraction 
when the luminous level of the feature-region varies 
in space and in time. 

It is another object of the present invention to pro- 
55 vide a feature-region extraction method whereby a 
small color difference region is a common region of 
two color difference signals binarized by the use of 
specified thresholds and a feature-region is easily 
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extracted therefrom. 

It is another object of the present invention to pro- 
vide a feature-region extraction method whereby a 
feature-region is extracted from a plurality of small 
color difference region so as to further improve the 5 
image quality. 

It is another object of the present invention to pro- 
vide a feature-region extraction method whereby a 
feature-region along its contour line is extracted to- 
gether with a lacking region sandwiched in between 10 
the feature-region contour line so as to further im- 
prove the image quality. 

It is another object of the present invention to pro- 
vide a feature-region extraction method whereby a 
feature-region is extracted from a common region of 15 
two color difference signals binarized by the use of 
specified thresholds and lacking regions within the 
feature-region are filled up by using detection pat- 
terns weighted by distance so as to further improve 
the image quality. 20 

It is another object of the present invention to pro- 
vide a feature-region extraction method whereby in 
extracting a feature-region by using means for ex- 
tracting a feature-region and a memory means for 
storing a feature-region extraction signal, a criterion 25 
is given a hysteresis characteristic depending upon 
whether a pixel backed by L frames (L is a positive in- 
teger) and/or its neighbor pixel is a feature-region or 
not, making it possible to effectively prevent the fea- 
ture-region from being extracted with flickers and 30 
thereby to further improve the subjective image qual- 
ity. 

It is another object of the present invention to pro- 
vide a feature-region extraction method whereby a 
feature-region is extracted by using its characteristic, 35 
feature-region extraction signals of plural frames 
from a memory of M frames (M is a positive integer) 
are weighted for extracting a weighted feature-region 
so as to further improve the image quality. 

It is another object of the present invention to pro- 40 
vide a feature-region extraction circuit whereby a fea- 
ture-region extraction circuit that includes a means 
for extracting a main portion of a feature- region and 
for filling a lacking region can extract a feature-region 
exactly along its contour line, and thereby adaptive 45 
processing of an image region other than the featured 
one with a low-pass filter can be performed free from 
the image deterioration. 

A feature-region extracting method, according to 
the present invention, can extract a feature-region by so 
using a small color difference region including a fea- 
ture color difference component of a feature-region 
within a color difference coordinate system having 
two axes representing two respective color differ- 
ence signals, eliminating the possibility of erroneous- 55 
ly extracting any other moving object than the fea- 
ture-region. Furthermore, the method is capable of 
exactly extracting a feature-region along its contour, 



allowing adaptive processing with a low-pass filter to 
improve the subjective image quality without empha- 
sizing the extracted region's contour. It binarizes two 
color difference signals by use of specified thresh- 
olds to produce a common region and extracts there- 
from a feature-region without erroneously extracting 
any other moving object than the feature-region. 

According to the present invention, a feature-re- 
gion can be extracted from a plurality of small color 
difference regions including a feature color differ- 
ence component of a feature-region, and no other re- 
gion than the featured one can be extracted even in 
the case when feature color difference components 
are widely dispersed within a color difference coor- 
dinate system having two axes representing two color 
difference signals. 

In addition, since a feature-region can be correct- 
ly extracted along its contour line, it is possible to ap- 
ply any adaptive processing such as pre-filter proc- 
essing, which is a low- pass filter processing control- 
led by an extracted signal, or a quantizing control for 
roughing the step-size of the quantization of a back- 
ground region to improve the subjective image quality 
without unnaturally emphasizing the contour line of 
the extracted feature-region. 

To realize the above-mentioned purposes, the 
present invention was made to provide: 

(1) A feature-region extracting method which de- 
termines a small color difference region including 
a feature color difference component of a fea- 
ture-region within a color difference coordinate 
system defined by two axes of two color differ- 
ence signals and which extracts an image region 
that has a color difference component within a 
small color difference region mentioned above as 
a feature-region; 

(2) A means to makes a small color difference re- 
gion be a common region having two color differ- 
ence signals binarized by certain thresholds and 
which extracts a feature-region therefrom; 

(3) A means to extract a feature- region from a 
plurality of small color difference regions(in addi- 
tion to item (1) or (2)); or 

(4) A means to extract a feature-region along its 
contour line together with a lacking region sand- 
wiched in between the contour line of the feature- 
region as a feature region; or 

(5) A means to binarize two color difference sig- 
nals of an image by certain thresholds, extract a 
feature-region from the common region of the bi- 
narized color difference signals and detect pat- 
terns for blank filling which are suitably weighted 
according to the distance for filling up the lacking 
region; or 

(6) A means to provide a criterion with an hyster- 
esis characteristic depending upon whether a 
pixel backed by L frames (L is a positive integer) 
and/or an adjoining one relating to a feature-re- 
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gion or not and uses it when extracting a feature- 
region by using a means for extracting the fea- 
ture-region and a memory means for storing a 
feature-region extraction signal; or 

(7) A means, to extract a feature-region by using 5 
its characteristic, generate output signals of fea- 
ture-region extraction of frames from a memory 

of M frames (M is a positive integer) and make the 
frame feature- region extraction signals weighted 
to extract a weighted feature-region; or 10 

(8) A feature-region extraction circuit which com- 
prises a feature-region main-portion extracting 
circuit for extracting an image region having a 
feature color difference component of a feature- 
region and a blank filling circuit for filling up a 15 
lacking region which is sandwiched in between 

the feature-region and which has a different color 
difference component other than the featured 
one; and further, 

(9) A means to include the feature-region main- 20 
portion extracting circuit which is comprises a 
comparison circuit for comparing two color differ- 
ence signals with the upper limit threshold and 

the lower limit threshold, and an AND gate circuit 
for determining the logical product of outputs of 25 
the comparison circuit and extracting a common 
region; and further, 

(10) A means to include another feature-region 
main- portion extracting circuit which is compris- 
es a first comparison circuit for comparing two 30 
color difference signals with a first upper limit 
threshold and a first lower limit threshold, a first 
AND gate circuit for determining a logical product 

of outputs of the first comparison circuit and ex- 
tracting a common region, a second comparison 35 
circuit for comparing two color difference signals 
to a second upper limit threshold and a second 
lower limit threshold, a second AND gate circuit 
for determining a logical product of outputs of the 
second comparison circuit and extracting a com- 40 
mon region and an OR gate circuit for determining 
a logical sum of the first comparison circuit's out- 
put and the second comparison circuit's output 
and extracting feature regions distributed to a 
plurality of regions. 45 

BRIEF DESCRIPTION OF DRAWINGS 

Figs. 1A, 1Band 1C show a diagram for explain- 
ing an interframe difference according to the pri- so 
or art; 

Figs. 2A, and 2B are a diagram for explaining a 
conventional method for plotting a histogram; 
Figs. 3A, 3B and 3C are a diagram for explaining 
a conventional face- region extraction; 55 
Fig. 4 is a block diagram for explaining a feature- 
region extraction circuit embodied in the present 
invention; 



Fig. 5 is a diagram (1) for explaining the distribu- 
tion of the skin-color of a person, according to the 
present invention; 

Fig. 6 is a diagram (2) for explaining the distribu- 
tion of the skin-color of a person, according to the 
present invention; 

Fig. 7 is a diagram (3) for explaining the distribu- 
tion of the skin-color of a person, according to the 
present invention; 

Fig. 8 is a diagram showing an example of a cir- 
cuit for extracting the main portion of a feature- 
region according to Fig. 4; 

Fig. 9 is a diagram showing another example of 
a circuit for extracting the main portion of a fea- 
ture-region according to Fig. 4; 
Fig. 10 is a diagram showing a further example 
of a circuit for extracting the main portion of a fea- 
ture-region according to Fig. 4; 
Figs. 11A, 11B, 11C and 11 D show a small region 
eliminating detection pattern (1 ), according to the 
present invention; 

Figs. 12A, 12B, 12Cand 12Dshow detection pat- 
terns (1) for blank filling, according to the present 
invention; 

Figs. 1 3A, 1 3B, 1 3C and 1 3D show detection pat- 
terns (2)for blank filling, according to the present 
invention; 

Figs. 14A, 14B, 14C and 14D show detection pat- 
terns (3) for blank filling, according to the present 
invention; 

Figs. 15A, 15B, 15Cand 15D show detection pat- 
terns (4) for blank filling, according to the present 
invention; 

Fig. 16 shows another example of a feature-re- 
gion extraction circuit, according to the present 
invention; 

Figs. 17A, 17B, 17Cand 17D show detection pat- 
terns (2) for eliminating a small region, according 
to the present invention; 

Fig. 18 shows detection patterns (3) for eliminat- 
ing a small region, according to the present inven- 
tion; 

Figs. 19A, 19B, 19C and 19D show a pattern (4) 
forjudging a face-region of a preceding frame for 
eliminating a small region according to the pres- 
ent invention; 

Fig. 20 shows another example of a feature-re- 
gion extraction circuit according to the present in- 
vention; 

Fig. 21 shows weight coefficients according to 
the present invention; 

Fig. 22 shows coefficients of a pre-filter accord- 
ing to the present invention; and 
Figs. 23A and 23B show variables of adaptive 
control according to the present invention. 
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PREFERRED EMBODIMENT OF THE INVENTION 

Figs. 1 A to 1C are diagrams for explaining a con- 
ventional interframe difference signal, Figs. 2A and 
2B are diagrams for explaining a conventional histo- 
gram plotting method and Figs. 3Ato 3C are diagrams 
for explaining a conventional face-region extracting 
method. 

The prior art first determines the difference sig- 
nal between two neighboring frames (frame N shown 
in Fig. 1 A and frame N+1 shown in Fig. 1B) of the mo- 
tion picture inputted to get the interframe differential 
image shown in Fig. 1C and then divides the inter- 
frame differential image into rectangular regions as 
shown in Fig. 2A. In the respective rectangular re- 
gions, the method makes a histogram representing 
the number of pixels, in which the interframe differ- 
ence signal is larger then a certain threshold, on an 
H-axis as shown in Fig. 2B. The method scans the his- 
togram from the left and the right comparing its val- 
ues with a certain threshold "th" to detect the left and 
right ends of the moving regions. 

As shown in Fig. 3A, the image screen is scanned 
from the upper left end until a first moving region is 
found. This moving region has a coordinate on a V- 
axis f which represents a position at the top of one's 
head. The image screen is then scanned from the left 
and the right by a certain range of lower image to de- 
termine the left and right ends of the moving region 
as shown in Fig. 3B. And then, the outermost posi- 
tions of the moving region on the H-axis represent the 
coordinates of the left and right ends of the face. The 
face length is determined by multiplying the face 
width by a predetermined coefficient "a" as shown in 
Fig. 3C. The prior art considers the thus determined 
image region as a face-region. 

As mentioned above, the conventional feature- 
region extracting method estimates a face-region 
from an interframe difference representing the 
amount of motion. Consequently, if the image in- 
cludes any other moving object than the face-region, 
the prior art method may erroneously take the object 
as a face part. Furthermore, the method can roughly 
extract a face-region only in the form of a rectangle, 
which contour may be emphasized when the regions 
other than the face are adaptively processed with a 
low-pass filter. This may impair the subjective image 
quality. 

Referring now to the accompanying drawings, 
preferred embodiments of the present invention will 
be described in detail as follows: 

Fig. 4 is a block diagram for explaining an em- 
bodiment (1) of a feature-region extracting circuit ac- 
cording to the present invention, which comprises a 
feature-region main-portion extracting circuit 1, a 
small region eliminating circuit 2 and a blank filling cir- 
cuit 3. The feature-region main-portion extracting cir- 
cuit 1 extracts an image region, including therein a 



feature color difference component of a feature-re- 
gion and passes the extraction signal to a small re- 
gion eliminating circuit 2 whereby a small region is 
eliminated as a portion erroneously extracted by the 

5 effect of noise or the like. The output signal from the 
small region eliminating circuit 2 is passed to the 
blank filling circuit 3 which fills up a lacking region 
which has a color difference component other than 
the featured one and then produces a feature-region 

10 extraction signal. 

The present invention provides a method for ex- 
tracting a face-region, utilizing the characteristic that 
skin-color components occupying most of one's face- 
region as shown in Fig. 5, concentrate on a small coi- 
rs or difference region (hatched portion) within the color 
difference region defined by a coordinate system in- 
dicating a U-signal level on a vertical axis and a V-sig- 
nal level on a horizontal axis. As shown in Fig. 6, the 
small color difference region is made a common re- 

20 gion by binarizing two color difference signals of an 
image through the specific thresholds and then face- 
region is extracted therefrom. In short this method is 
made to extract a face-region on the basis that its fea- 
ture (skin) color is apt to concentrate on a small color 

25 difference region (enclosed by line segments C H u» 
C L u. Ohv C lv ) within a coordinate system indicating a 
U-signai level on a vertical axis and a V-signal level 
on a horizontal axis. 

Even if the skin color that occupies most of a hu- 

30 man face-region is distributed to a plurality of small 
color difference regions (e.g. the area A enclosed by 
line segments C H ui. C L ui. Chvi. ^ LV1 anc * an area ^ 
enclosed by line segments C H u2» O uu2 , C H v2» Clv2 as 
shown in Fig. 7) within a coordinate system indicating 

35 a U-signal level on a vertical axis and a V-signal level 
on a horizontal axis as shown in Fig. 7, it is possible 
to extract the face-region exactly without error. 
Indeed, since human skin color components may be 
distributed to a plurality of small color difference re- 

40 gions of, e.g., whitish, blackish or any other hue, it is 
desirable to extract a face- region by the method of the 
present invention. 

Fig. 8 shows an example of the feature-region 
main-portion extracting circuit shown in Fig. 4, which 

45 uses a memory 4 for realizing the feature-region ex- 
tracting method shown in Fig. 5. 

The feature-region main-portion circuit 1 ex- 
tracts a skin-color region occupying the major portion 
of one's face-region . This circuit 1 can be composed 

so of a memory 4 such as a random access memory, a 
read-only memory and so on. The memory 4 stores 
two color difference signals U and V which are con- 
nected to its addresses A1 5 - A8 and A7 - AO respec- 
tively. In the memory space represented by 1 6-bit ad- 

55 dresses, one area corresponding to the hatched re- 
gion of Fig. 5 js filled with the digit 1 (logical one) and 
other regions are filled with the digit 0 (logical zero). 
Accordingly, an output D of the memory 4 is 1 when 
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the signals U and V are signals of a skin-color region 
corresponding to the hatched region shown in Fig.5, 
and changes to 0 when the signals U and V are related 
to a region other than the face's. The main portion of 
a face-region can be thus extracted. However, a face- s 
region extracted at this step lacks the regions such as 
the eyes, the eyebrows and the lips, differing in color 
from the skin-color portion. Furthermore, it may also 
include a region or regions other than the face-region, 
which were erroneously extracted because of noise 10 
or the like. 

Fig. 9 shows another example of a feature-region 
main-portion extracting circuit shown in Fig. 4, which 
is composed of comparison circuits 5 to 8 and an AND 
gate circuit 9 to embody the feature-region extraction is 
method shown in Fig. 6. 

The comparison circuits 5 to 8 compare two color 
difference signals (U and V) with the upper and lower 
limit thresholds C H u* C LU , C HV , C LV . The comparison 
circuit 5 provides an output signal having the logical 20 
value of 1 when U ^ C H u- Similarly, the comparison 
circuits 6 to 8 provide output signals having a logical 
value of 1 respectively when U ^ C LU , V ^ Chv and V 
S C LV . Output signals of these comparison circuits 5 
to 8 are passed to the AND gate circuit 9 which pro- 25 
vides a logical product of the output signals, extract- 
ing therefrom a common region. Consequently, the 
output of the AND gate circuit includes the logical val- 
ue of 1 for the skin-color region enclosed by line seg- 
ments Chu» C lu , C H v. C uv shown in Fig. 6. Amain por- 30 
tion of a face-region can be thus extracted, but it lacks 
the regions such as the eyes, the brows and the lips, 
differing in color from the skin-color portion and may 
also include a region or regions other than the face- 
region, which were erroneously extracted because of 35 
a noise or the like. 

Fig. 10 illustrates a further example of a feature- 
region main-portion extracting circuit shown in Fig. 4, 
which is composed of comparison circuits 10 to 13 (for 
comparing with first upper and lower limit thresholds), 40 
a first AND gate circuit 14, comparison circuits 15 to 
18 (for comparison with second upper and lower limit 
thresholds), a second AND gate circuit 19 and an OR 
gate circuit 20 to realize the feature-region extraction 
method shown in Fig. 7. 45 

The comparison circuits 10 to 13 compare two 
color difference signals (U and V) with upper and low- 
er limit thresholds C HU i. C LU i. Chvi, C LV i. The compar- 
ison circuit 10 provides an output signal of a logical 
value of 1 when U ^ C HU i. Similarly, the comparison so 
circuits 11 to 13 provide output signals of the logical 
value of 1 respectively at U ^ C LU t, V ^ C HV1 and V ^ 
C LV i- The comparison circuits 15 to 18 compare two 
color difference signals (U and V) with upper and low- 
er limit thresholds C HU 2. C LU2 , c hv2» C LV2 . The compar- 55 
ison circuit 15 provides an output signal of a logical 
value of 1 when U ^ C HU2 . Similarly, the comparison 
circuits 16 to 18 provide output signals of the logical 



value of 1 respectively at U S C LU2 , V =i and V £ 
C LV2 . Output signals of the comparison circuits 10 to 
13 are passed to the first AND gate circuit 14 which 
provides a logical product of the output signals, ex- 
tracting a common region. Output signals of the com- 
parison circuits 15 to 18 are passed to the second 
AND gate circuit 19 which provides a logical product 
of the output signals, extracting therefrom a common 
region. 

The outputs of the AND gate circuits 14 and 19 
are passed to the OR gate circuit 20 which provides 
a logical sum of the outputs. Consequently, the out- 
put of the OR gate circuit 20 is a logical value of 1 for 
both the feature-region A enclosed by line segments 
C H ui. C LU1l Chvi and C L vi and the feature-region en- 
closed by line segments C HU 2, C LU2 , C„v 2 and C LV2 as 
shown in Fig. 7. The main portion of a face-region can 
thus be extracted with no error even if an attribute of 
a feature-region is distributed to a plurality of regions 
within a coordinate system indicating a U-signal level 
on a vertical axis and a V-signal level on a horizontal 
axis. However, the face-region extracted at this step 
lacks the regions such as the eyes, the eyebrows and 
the lips, differing in color from the face's skin-color 
portion and may also include a region or regions other 
than the face-region which were erroneously extract- 
ed because of a noise or the like. 

Therefore, the extraction signal from the feature- 
region main-portion extracting circuit 1 enters the 
small region-eliminating circuit 2 (shown in Fig. 4) 
which determines a small region erroneously detect- 
ed and eliminates it as a region detected due to the 
effect of noise. This circuit compares a feature- region 
signal with each of four detection patterns shown in 
Figs. 11A to 11D and gives a logical value of 0 to the 
center pixel of a window of 3 x 3 pixels as a region 
other than the face when no match is found. A center 
pixel is judged to be a face-region when a logical prod- 
uct of 6 pixels(C .circle) shown in a circular form is 1 
in each detection pattern. 

The output signal from the small region eliminat- 
ing circuit 2 is passed to the blank filling circuit 3 which 
compares its input signal with each of four detection 
patterns shown in Figs. 12A to 12D and gives a logical 
value of 1 to a center pixel of a window of 13 x 1 3 pix- 
els as a face-region when a match is found. A center 
pixel is judged as a face-region when both logical 
sums of 6 pixels (A :triangles) and 6 pixels ( 0 :dia- 
monds) are 1 in each detection pattern. Detection 
patterns other than those shown in Figs. 12A to 12D 
may be used if they have a similar effect. For exam- 
ple, patterns shown in Figs. 1 3A to 1 3B are applicable 
as detection patterns. Furthermore, it is possible to 
use both of these detection patterns (8 patterns) in 
such a way that the logical value of 1 is given to a cen- 
ter pixel of a window when a signal pattern matches 
any one of the eight detection patterns. 

The above-mentioned face-region extraction 
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method can prevent erroneous extraction of any mov- 
ing object other than the face-region and extract the 
face-region exactly along its contour line, making it 
possible to adaptivefy process any other region than 
the face through the face-region extraction signal, 5 
e.g., with a low-pass filter without unnaturally empha- 
sizing the contour lines of the face-region and thereby 
not impairing the subjective image quality. 

Although the above-described embodiment of 
the present invention performs the extraction of a 10 
face-region, it is also capable of extracting any fea- 
ture-region other than the face by changing thresh- 
olds for color difference signals. The present inven- 
tion also provides the possibility to extract a feature- 
region by using a luminous signal in combination with is 
color difference signals or by using color signals R, G, 
B and so on. In addition, windows having sizes other 
than 3x3 and 13 x 13 are also applicable to perform- 
ing the process to eliminate erroneously extracted 
small regions and to fill lacking regions with the same 20 
effect. The present invention can also provide a fea- 
ture-region extraction method that does not include 
the small region eliminating circuit but assures a like 
effect. 

As described above, the present invention pro- 25 
vides a feature-region extraction method whereby a 
small color difference regions having a feature color 
difference component of a feature-region of an image 
is located within a color difference coordinate system 
defined by two axes representing two color differ- 30 
ence signals and an image region that has a color dif- 
ference component within a small color difference re- 
gion mentioned above is then extracted as a feature- 
region. In case the feature-region includes a portion 
having another color difference signal than the fea- 35 
tured one, the extracted feature-region includes 
therein lacking regions that, however, can be filled up 
to produce a complete feature-region. 

The blank filling circuit 3 compares the feature 
extraction signal with each of four detection patterns 40 
shown in Figs. 1 4(a) to 14(d) and judges a center pixel 
of a window of 1 3 x 13 pixels as a feature-region and 
gives it a logical value of 1 when a match is found. In 
each detection pattern, a logical product of pixels 
shown in the form of a triangle(A ) and a circle(C ) 45 
(logical product (1)), a logical product of pixels shown 
in the form of a black triangle (▲ ) and a circle 
(C )(logical product (2)), a logical product of pixels in 
the form of a square (□ ) and a circle (O ) (logical 
product (3)) and a logical product of pixels shown in 50 
the form of a black square (■ ) and a circle(G ) (logical 
product (4)) are first determined for each solid line, 
then a logical sum (1) of the logical products (1) and 
the logical products (2) of all lines is determined, a 
logical sum (2) of the logical products (3) and the log- 55 
ical products (4) of ail lines is determined and a logical 
product of the logical sum (1) and the logical sum (2) 
is finally calculated. A center pixel of the window of 1 3 



x 13 pixels is judged as a feature-region if the result 
of the final logical operation is 1 . 

Detection patterns other than those shown in 
Figs. 14A to 14D are also used with the similar effect. 
For example, detection patterns shown in Figs. 15A 
to 15D may be applied. A center pixel of a window of 
13x13 pixels is considered as a feature-region hav- 
ing a logical value of 1 when the feature-region ex- 
traction signal matches any one of these four detec- 
tion patterns. In each detection pattern, a logical 
product of pixels shown in the form of a triangfe(A ) 
and a circle(C ) (logical product (1)) and a logical 
product of pixels shown in the form of a black trian- 
gle(A ) and a cirde(G )(logical product (2)) are first 
determined for each solid line, and a logical sum of the 
logical products (1) and the logical products (2) of all 
lines is then determined. A center pixel of the window 
of 13 x 13 pixels is judged as a feature-region if the 
result of the final logical operation is 1. 

It is also possible to use a combination of both the 
detection patterns shown in Figs. 14 and 15 in such 
a way that a center pixel of a window of 1 3 * 1 3 pixels 
is judged as a feature-region and is given a logical val- 
ue of 1 if a match with any one of eight detection pat- 
terns is found. 

Fig. 16 shows another example (embodiment 2) 
of a feature-region extraction circuit according to the 
present invention, which comprises a feature-region 
main-portion extracting circuit 21 , a small region elim- 
inating circuit 22, a blank filling circuit 23 and a frame 
memory 24. The operation of this feature-region ex- 
traction circuit is as follows: 

Similarly with the case of the embodiment of Fig. 
4, the feature-region main- portion extracting circuit 
21 extracts a skin-color region, occupying most of 
one's face-region. The extracted face-region, how- 
ever, lacks different color regions such as the eyes, 
the eyebrows and the lips, and may include a region 
other than the face which was erroneously detected 
as a skin-color region because of a noise signal. 
Therefore, an extraction signal generated by the fea- 
ture-region main-portion extracting circuit 21 is sent 
to the small region eliminating circuit 22 whereby a 
small region, erroneously extracted due to the effect 
of a noise signal, is eliminated from the extraction sig- 
nal. The output of the small region eliminating circuit 
is stored to the frame memory 24 and a signal de- 
layed by one frame is returned to the small region 
eliminating circuit 22. 

The small region eliminating circuit 22 may use 
detection patterns shown in Figs. 17Ato 17D in the 
case an extraction signal delayed by one frame from 
the frame memory 24 is not a face-region and a de- 
tection pattern shown in Fig. 18 in the case the ex- 
traction signal delayed by one frame from the frame 
memory 24 is a face-region. In case the extraction 
signal delayed by one frame is not a face-region, a 
present extraction signal is compared with each of 
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four detection patterns shown in Figs. 1 7A to 1 7D and 
a center pixel of a window of 5 x 5 pixels is recognized 
as a region other than the face and is given a logical 
vaJue of 0 when no match is found. In each of the de- 
tection patterns, a center pixel is recognized as a s 
face-region when a logical product of 1 5 pixels shown 
in the form of a circle is 1. On the other hand, in the 
case the extraction signal delayed by one frame is a 
face-region, a present extraction signal is compared 
with the detection pattern shown in Fig. 18 and a cen- w 
ter pixel of a window of 3 x 3 pixels is recognized as 
a region other than the face and is given a logicaJ val- 
ue of 0 when no match is found. In this pattern, a cen- 
ter pixel is recognized as a face-region when a logical 
sum of 9 pixels shown in the form of a circle is 1 . 15 

Another example of detection patterns may be 
applicable in the small region eliminating circuit 22: 
The detection patterns shown in Figs. 19A to 19D are 
used for an extraction signal delayed by one frame 
from the frame memory 24. In the case they do not 20 
match any one of 4 detection patterns shown in Figs. 
1 9A to 1 9D and is not recognized as a face-region, the 
detection patterns shown in Figs. 17A to 17D are 
used as the detection patterns for the present extrac- 
tion signal. On the other hand, in the case they match 25 
any one of 4 detection patterns shown in Figs. 19Ato 
1 9D and is recognized as a face-region, the detection 
pattern shown in Fig. 18, are used as the detection 
pattern for the present extraction signal. In each of 
the detection patterns of Figs. 19Ato 19D, the extrac- 30 
tion signal delayed by one frame is judged as a face- 
region when a logical product of 3 pixels shown in the 
form of a circie(C ) is 1 or 1 pixel shown in the form 
of a black circle(# )is 1. 

In the case the extraction signal delayed by one 35 
frame is not a face-region, a present extraction signal 
is compared with each of 4 detection patterns shown 
in Figs. 17A to 17D and a center pixel of a window of 
5x5 pixels is given a logical value of 0 as a region 
other than the face when no match is found. In this 40 
case, each pattern is used in such a way that the cen- 
ter pixel is recognized as the face-region when a log- 
ical product of 1 5 pixels, shown in theform of a circle, 
is 1. 

On the other hand, in the case the extraction sig- 45 
nal is a face-region, a present extraction signal is 
compared with the detection pattern shown in Fig. 18 
and a center pixel of a window of 3 x 3 pixels is given 
a logical value of 0 a region other than the face when 
no match is found. This detection pattern is used in so 
such a way that the center pixel is recognized as the 
face-region when a logical sum of 9 pixels, shown in 
the form of a circle, is 1. 

These detection patterns provide a relaxed face- 
region criterion for the present extraction signal when 55 
the extraction signal delayed by one frame is a face- 
region. In short, a hysteresis characteristic is given to 
each face-region detection pattern for the present 



signal. This may increase the margin for noise to pre- 
vent the face-region from being extracted with flick- 
ers. The output signal of the small region eliminating 
circuit 22 enters the blank filling circuit 23 that, simi- 
larly to the case of the embodiment 1, fills up lacking 
regions (the eyes, the eyebrows, the lips and so on) 
of the face-region with different colors other than the 
face's skin-color. 

The above-mentioned face-region extraction 
method eliminates the possibility of erroneously ex- 
tracting any moving object other than the face-region. 
A face-region can be extracted exactly along its con- 
tour line, therefore the face-region extraction signal 
may withstand the adaptive processing of portions 
other than the face-region, for example, with a low- 
pass filter, assuring that the subjective image quality 
is not impaired by unnaturally emphasized boundar- 
ies. According to the present invention, it is possible 
to prevent a face-region from being distorted with 
flickers that are easily detected by human eyes. This 
feature may considerably improve the subjective im- 
age quality. 

Although the above-described embodiment is 
used for extracting the face-region of an image, it can 
extract any kind of feature- region other than the face 
by changing the thresholds for color difference sig- 
nals. The small region eliminating circuit can also use 
detection patterns having other sizes than the win- 
dows of 3 x 3 and 5 x 5 pixels or may work with other 
patterns having like effects. Similar effects can be 
obtained by giving a hysteresis characteristic to 
thresholds of the feature- region extraction circuit or 
to detection patterns of the blank filling circuit. 

According to the present invention, it is possible 
to obtain the same effects as those of the small region 
eliminating circuit and the blank filling circuit even if 
either of these circuits is not provided. 

The feature-region extraction method according 
to the present invention can extract a face-region with 
no flicker noise by giving a hysteresis characteristic 
to a face-region criterion depending upon whether a 
pixel of a frame backed by L frames (L is a positive 
integer) and/or its neighboring pixel is a feature-re- 
gion or not. 

Fig. 20 shows another example (embodiment 3) 
of a feature-region extraction circuit according to the 
present invention wherein a frame memory is indicat- 
ed by numeral 31 and other components similar in 
function to those of Fig. 4 are given the same numer- 
als. 

The frame memory 31 generates a series of fea- 
ture-region extraction signals of frame No. N (N is a 
positive integer), N-1, N-2 N-M (M is a positive in- 
teger) through a memory of M frames (M is a positive 
integer) . These feature-region extraction signals are 
weighted to get therefrom feature-region extraction 
signals F N weighted to be adaptively processed by 
pre-filtering or quantification control. 
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The weighted feature-region extraction signal F N 
is expressed as follows: 



where a N indicates whether a feature-region extrac- 
tion signal of a frame N relates to a face-region (a N =1 ) 10 
or not (a N =0: background region) and K| is a weight 
coefficient of a frame No. (N-l). 

If M=3, K, can take, for example, any one of val- 
ues (weight coefficient) shown in Fig. 21. In the case 
of the example (1) all of K 0 to K 3 are 1 . In the case of 15 
the example (2) Ko and K 3 are 1 and and K 2 are 2. 
In the case of the example (3), Ko is 4, K t is 2, K 2 and 
K 3 are 1. 

When a two-dimensional pre-fi Iter for processing 
a luminous signal, a color difference signal has a 20 
coefficient shown in Fig. 22, a variable of adaptive 
control can take, e.g., values shown in Fig. 23A and 
23B. Figs. 23A and 23B show adaptive control vari- 
ables respectively in the case of not- weigh ted or 
weighted control. Fig. 23B shows a case that a fea- 25 
ture-region extraction signal F N is weighted as shown 
in the example (1) of Fig. 21. In case of the feature- 
region extraction signal F N being not-weighted, the 
coefficient P of the two-dimensional pre-f ilter is equal 
to 1 and a variation AO of a quantizing step size is 30 
equal to +10 when the feature-region extraction sig- 
nal F N is 0, whereas P=8 and AQ=0 when the signal 
F N is 1. In case of the feature-region extraction signal 
F N being weighted, P=1 and AQ=+10 are obtained 
when the feature-region extraction signal F N is 0. P=2 35 
and AQ=+5 are obtained when the signal F N is 1 , P=4 
and AQ=+2 when the signal F N is 2, P=8 and AQ=0 
when the signal F N is 3, and P=8 and AQ=0 when the 
signal F N is 4. 

According to the present invention, it is possible 40 
to use an output signal of the blank filling circuit 3 as 
a feature-region extraction signal to be adaptively 
processed with a pre-f ilter or by quantization control. 
Furthermore, it is also possible to put an output signal 
from the blank filling circuit 3 into the frame memory 45 
31 and use an output signal of the frame memory 31 
as a feature-region extraction signal. 

Application of the weighted feature-region ex- 
traction signal may not impair the image quality even 
if the signal includes any erroneously detected por- so 
tion. Noise may damage a feature-region extraction 
signal in such a way that a certain portion may be er- 
roneously extracted with discontinuity of time. In such 
case, if adaptive control variables shown in Fig. 23A 
are used, P and AQ can considerably vary depending 55 
upon whether the feature-region extraction signal is 
0 or 1, resulting in that the signal includes flicker por- 
tions thus impairing the image quality. On the contra- 



ry, if weighted adaptive control variables shown in 
Fig. 23B are used, the adaptive control variables vary 
smoothly as the feature-region extraction signal 
changes from 0 to 4. This may reduce the deteriora- 
tion of the image quality. 

The face-region extraction method according to 
the present invention eliminates the possibility of er- 
roneously extracting any moving object other than the 
face. Since the face-region can be extracted exactly 
along its contour line, the face-region extraction sig- 
nal may withstand the adaptive processing of a back- 
ground region with a low-pass filter or/and by quanti- 
zation control for roughing the quantization step size 
of the background region/thereby assuring not to im- 
pair the subjective image quality with an unnaturally 
emphasized boundary. 

Although the above-described embodiment is 
used for extracting the face-region of an image, it can 
extract any kind of feature-region other than a face by 
changing the thresholds for color difference signals. 
It is also possible to perform a feature-region extrac- 
tion by using luminous signals in combination with 
color difference signals or by using color signals such 
as R, G, B and so on. The windows with different sizes 
other than 3x3 and 13x13 pixels may be applicable 
with like effects for small region elimination and blank 
filling processing. The feature-region extracting 
method, according to the present invention, can real- 
ize the fine extraction of a feature-region on an image 
without a small region eliminating circuit. 

As this invention may be embodied in several 
forms without departing from the spirit of essential 
characteristics thereof, the present embodiment is 
therefore illustrative and not restrictive, since the 
scope of the invention is defined by the appended 
claims rather than by the description preceding them, 
and all changes that fall within meets and bounds of 
the claims, or equivalence of such meets and bounds 
are therefore intended to embraced by the claims. 



Claims 

1 . A method of feature-region extraction which com- 
prises extracting a feature-region of an image 
when processing the image according to its fea- 
ture, characterized by the step of determining a 
small color difference region including a feature 
color difference component of a feature-region 
within a color difference coordinate system de- 
fined by two axes representing two respective 
color difference signals and extracting an image 
region having a color difference component in the 
small color difference region mentioned above as 
the feature-region. 

2. A method of feature-region extraction according 
to claim 1, characterized by the small color differ- 
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ence region is a common region of two color dif- 
ference signals binarized by respective specified 
thresholds where the feature-region is extracted 
therefrom. 

3. A method of feature- region extraction according 
to any one of claims 1 and 2. characterized by the 
feature-region is extracted from a plurality of 
small color difference regions. 



10 



4. A method of feature- region extraction with com- 
prises extracting a feature- region of an image 
when processing the image according to its fea- 
ture, characterized by the step of extracting a 
feature-region along its contour line together with 15 
a feature lacking region sandwiched in between 
the feature contour line of the feature- region as 
a feature-region. 
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5. A method of feature-region extraction which com- 
prises extracting a feature-region of an image 
when processing the image according to its fea- 
ture, characterized by a feature-region is extract- 
ed from a common region of two color difference 
signals of an image, said signals being binarized 
by specified thresholds, and a lacking region 
within the feature-region is filled up by using de- 
tection patterns weighted by distance. 



6. A method of feature-region extraction which com- 30 
prises extracting a feature-region of an image 
when processing the image according to its fea- 
ture, characterized by the step of extracting a 
feature-region by using a means for extracting it 
and a memory means for storing the feature-re- 35 
gion extraction signal, uses a criterion provided 
with a hysteresis characteristic depending upon 
whether a pixel of a frame backed by L frames (L 
is a positive integer) and/or the adjoining pixel re- 
lates to a feature- region or not. 40 

7. A method of feature-region extraction with com- 
prises extracting a feature- region of an image 
when processing the image according to its fea- 
ture, characterized by the step of extracting a 45 
feature-region by using its characteristic; gener- 
ates the feature-region extraction signals of 
frames from a memory of M frames (M is a pos- 
itive integer), weights the frame feature-region 
extraction signals and extracts a weighted fea- 50 
ture-region. 

8. A feature-region extraction circuit with comprises 
extracting a feature-region of an image when 
processing the image according to its feature, 55 
characterized by a feature-region main-portion 
extracting circuit(1) for extracting an image re- 
gion having a feature color difference component 



of a feature-region and a blank filling circuit(3) for 
filling a feature color lacking region which is a 
part of the feature-region and includes a color dif- 
ference component other than the feature one. 

9. A feature-region extraction circuit according to 
claim 8, characterized by the feature-region 
main-portion extracting circuit(1) comprising a 
comparison circuit(5),(6),(7),(8) for comparing 
two color difference signals with an upper limit 
threshold and a lower limit threshold, and an AND 
gate(9) circuit for determining the logical product 
of outputs of the comparison circuit(5),(6),(7),(8) 
and for extracting a common region. 

10. A feature-region extraction circuit according to 
claim 8, characterized by the feature-region 
main-portion extracting circuity ) is comprising a 
first comparison circuit(10),(11),(12),(13) for 
comparing two color difference signals with a 
first upper limit threshold and a first lower limit 
threshold; a first AND gate circuit(14) for deter- 
mining the logical product of the outputs of the 
first comparison circuity 0),(11),(12),(1 3) and for 
extracting a common region; a second compari- 
son circuit(15),(16),(17),(18) for comparing two 
color difference signals with a second upper limit 
threshold and a second lower limit threshold; a 
second AND gate circuit(19) for determining a 
logical product of the outputs of the second com- 
parison circuit(15),(16),(17),(18) and for extract- 
ing a common region; and an OR gate circuit(20) 
for determining the logical sum of the first com- 
parison circuit's output and the second compari- 
son circuit's output and for extracting feature re- 
gion distributed to a plurality of regions. 

11. A method of identifying a feature region in a video 
image comprising processing colour component 
signals (U,V) derived from a video signal repre- 
senting said video image so as to detect a said 
feature region as a region in which the image col- 
our produces for each said colour component sig- 
nal a signal value lying within a predetermined 
range (C lu -C H u.C lv -Chv) or ranges (C LUl - 
Chui/Clu2-C H u2.C L vi-Chvi/C LV 2-Chv2) associated 
with that component. 
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